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ABSTRACT 


Packet  switching  communication  networks  employ  routing 
protocols  to  determine  the  path  traversed  by  each  packet  as 
it  passes  through  the  network.  Routing  protocols  which  are 
adaptive  and  can  restructure  the  packet  paths  in  response  to 
localized  network  congestion  are  called  •'dynamic"  routing 
protocols.  Dynamic  routing  protocols  seek  to  optimize  the 
routing  (provide  the  shortest  path)  for  each  packet  in  the 
network.  Routing  protocols  which  are  unaffected  by  the 
addition  or  deletion  of  any  subset  of  nodes  are  called 
"distributed"  routing  protocols.  The  relative  performance 
of  two  distributed,  dynamic  routing  protocols  is  determined 
usir.a  computer  simulations.  The  protocols  are  implemented 
on  fcur  theoretical  networks  and  tested  under  a  range  of 
network  traffic  loads. 


4 


r ABLE  OF  CONTENTS 


I.  INTRODUCTION .  11 

A.  THE  PACKET  SWITCHING  CONCEPT .  11 

B.  NETWORK  PROTOCOLS .  13 

C.  DISTRIBUTED  ROUTING  PROTOCOLS  .  17 

II.  A  NAVAL  APPLICATION .  19 

III.  PARAMETERS  OF  A  PACKET  SWITCHING  NETWORK  ....  24 

A.  QUANTIFYING  PROTOCOL  PERFORMANCE  .  24 

3.  NETWORK  CON FIG3 RATION S  .  25 

C.  CHANNEL  VALUES .  33 

IV.  TWO  DISTRIBUTED  R03TING  PROTOCOLS  .  35 

A.  THE  HERITSC H  ALGORITHM .  35 

3.  THE  DJIKSIR  A  ALGORITHM .  39 

V.  SIMULATION  OF  THE  PROTOCOLS .  44 

A.  PROGRAMMING  SCHEME .  44 

3.  ARTIFICIALITIES  OF  THE  SIMULATION  PROGRAM  .  47 

C.  LIMITATIONS  OF  THE  SIMULATION  PROGRAM  ...  48 

D.  GENERATION  OF  DATA .  U9 

VI.  RESULTS  AND  CONCLUSIONS .  51 

A.  RESULTS .  51 

1.  Comparison  of  Average  Delivery  Delay  .  .  51 

C 


2.  Updating  Requirements  Versus  Network 

Complexity .  57 

3.  Synchronous  Versus  Asynchronous  Updating 

Performance .  60 

4.  Effects  Of  User  Message  Lengths  ....  61 

B.  SYNOPSIS  OF  RESULTS .  62 

APPENDIX  A .  65 

APPENDIX  B .  71 

APPENDIX  C .  73 

APPENDIX  D .  125 

APPENDIX  E .  129 

APPENDIX  F .  131 

LIST  OF  REFERENCES . 155 

INITIAL  DISTRIBUTION  LIST .  156 


/ 


LIST  OP  TABLES 


Significant  Network  Characteristics 
Update  Utilization  Factors  .... 


LIS!  OP  FIGURES 


4.1. 

4.2. 


F.  15. 


F.  16. 


The  5/10  Network .  33 

A  5/7  Network . .  41 

Initial  Channel  Value  Matrix  For  The  Djikstra 

Algorithm . 42 

The  Completed  Best  Path  Matrix .  43 

Expected  Average  Delay  Per  Packet .  52 

The  5/10  Network .  71 

The  10/20  Network .  71 

The  15/30  Network .  72 

The  20/40  Network  . .  72 


Delay:  Heritsch  (synrhi ,  Network  5/10  ....  131 

Delay:  Heritsch  (synch!  ,  Network  10/20  ....  132 

Delay:  Heritsch  (synchi  ,  Network  15/30  ....  133 

Delay:  Heritsch  (synch!.  Network  20/40  ....  134 

Delay:  Heritsch  (synch!  ,  Network  10/20  (2 


groups)  .  135 

Delay:  Heritsch  (synch!  ,  Network  15/30  (3 

groups) .  136 

Delay:  Heritsch  (asyacn)  ,  Network  10/20  ...  137 

Delay:  Heritsch  (asynch).  Network  15/30  .  .  .  138 

Delay:  Djikstra,  Network  5/10  139 

Delay:  Djikstra,  Network  10/20 .  140 

Delay:  Djikstra,  Network  15/30 .  141 

Delay:  Djikstra,  Network  20/40  .  142 

Utilization  Factor:  Heritsch  (synch).  Network 

5/10 .  143 

Utilization  Factor:  Heritsch  (synch).  Network 

10/20 .  144 

Utilization  Factor:  Heritsch  (synch).  Network 

15/30 .  145 

Utilization  Factor:  Heritsch  (synch).  Network 
2  0/40  146 


3 


F.  17 


Utilization  Factor:  Hacitsch  (synch).  Network 

10/20  (2  groups) .  147 

F.  18.  Utilization  Pactor:  Hecitsch  (synch).  Network 

15/30  (3  groups) .  148 

F.  19.  Utilization  Pactor:  Hecitsch  (asynch)  ,  Network 

10/20 .  149 

F.20.  Utilization  Pactor:  Hecitsch  (asynch).  Network 

15/30 .  150 

F.21.  Utilization  Factor:  Djikstra,  Network  5/10  .  .  151 

F.  22.  Utilization  Factor:  Djikstra,  Network  10/20  .  152 

F. 23.  Utilization  Factor:  Djikstra,  Network  15/30  .  153 

F. 24 .  Utilization  Factor:  Djikstra,  Network  20/40  .  154 


9 


ACKNOWLEDGMENT 


I  wish  to  express  my  sincere  thanks  to  Professor  John  M. 
Wozencraft  for  his  guidance  and  patience  during  the  course 
of  this  effort.  I  am  indebted  to  him  for  both  the 
concepts  and  the  methods  of  research  presented 
herein. 

I  dedicate  this  work  to  my  wife,  Linda,  whose  unselfish- 
love  and  support  made  it  all  possible. 


I.  introduction 


A.  THE  PACKET  SWITCHING  CONCEPT 

The  purpose  of  any  communications  network  is  to  provide 
paths  for  the  transmission  of  information.  It  is  desirable 
that  the  process  which  controls  the  transmission  and 
reception  of  messages  within  tha  network  ba  transparent  to 
the  user.  To  achieve  this  result  it  is  required  that  the 
ccmmunicat i cn  network  impose  a  tolerable  delay  in  the  ralay 
of  messages  between  the  originator  and  the  destination. 
Further,  the  network  should  require  a  minimum  number  of 
instructions  from  tha  originator  to  accomplish  the  task. 
Ideally,  the -originator  would  be  required  to  provide  only 
the  destination  of  the  message  to  the  network.  The 
communications  network  should  then  be  capable  of 
transmitting  messages  to  their  destinations  in  as  short  a 
time  as  possible. 

For  communications  networks  which  serve  many  users  and 
have  the  requirement  to  exchange  large  amounts  of  data,  the 
concept  of  "packet  switching™  may  provide  a  method  of 
operation  which  will  satisfy  Doth  the  speed  of  service  and 
the  transparency  requirements  of  the  user.  In  addition,  an 
increased  robustness  of  the  network  can  be  realized  without 
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;  creating  redundant  cicuitry  if  an  appropriate  routing 

J  algorithm  is  employe!  vita  in  the  network. 

The  packet  switching  concept  may  be  broadly  described  as 
the  coordinated  movement  of  soecified  length  data  streams 

S 

within  a  communications  networt  such  that  the  data  streams 
always  travel  the  least  congested  (ie.  guickest)  route 
I  between  the  originator  and  the  destination.  Packet 

switching  envisions  the  breakdown  of  a  message  into  fixed 
length  segments  (packets)  which  are  transmitted  through  the 
,  network  to  the  destination  by  the  "shortest  path"  (called 

the  best  path)  whica  is  known  to  exist  at  the  time  the 
packet  is  released  into  the  network.  The  implementation  of 

*1 

the  packet  switching  concept  requires  that  each  station 
(node)  in  the  network  be  capable  of  processing  certain  data 
i|  concerning  the  structure  of  the  network.  This  is  necessary 

so  that  the  correct  routing  can  be  assigned  to  each  packet 
as  it  is  released  oy  the  node  into  the  network.  This 
process  can  be  implemented  in  the  computer  software  which 
would  control  a  node's  participation  in  the  network.  It  is 
important  to  recognize  that  the  routing  of  different 
messages  is  not  independent  of  each  other,  since  (for 
example)  sending  all  traffic  via  one  particular  link  will 
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introduce  congestion  (queueing)  ielays  that  sight  be  avoided 
by  distributing  the  traffic  over  a  variety  of  available 
links. 

Packet  switching  techniques  can  be  used  to  transmit  both 
data  and  digitized  voice  signals.  While  the  transparency  of 
service  to  the  data  user  is  resolved  through  use  of  high  bit 
rate  transmission  systems  and  storage  buffers  at  each  node, 
the  real  time  requirement  for  intelligible  voice 
communications  may  require  the  establishment  of  a  dedicated 
circuit  for  each  conversation.  It  may  also  be  possible,  to 
establish  a  dedicated  voice  transmission  circuit  each  time 
the  transmitter  is  "keyed”  rather  than  maintain  a  circuit 
for  the  duration  of  the  conversation,  or  to  always  transmit 
over  *-he  same  route  (called  a  "virtual  circuit”)  and  to 
share  the  channel  capacity  * ith  other  messages  during 
interstices  in  the  conversation.  In  this  way  the  amount  of 
time  a  particular  set  of  links  remains  dedicated  to  a  single 
transmission  is  minimized. 

B.  NETWORK  PROTOCOLS 

Central  to  the  operation  of  any  communications  network 
is  the  set  of  instructions  which  directs  the  exchange  of 
network  information  oetween  nodes.  These  instructions  may 
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be  implemented  in  hardware  or  software  and  are  referred  to 
as  Network  Protocols.  Ths  information  contained  in  messages 
generated  by  these  protocols  is  used  by  the  communications 
network  to  implement  the  routing  of  user  message  traffic 
within  the  network.  Network  Protocols  are  commonly  divided 
intc  several  hierarchical  levels  according  to  their 
particular  function  within  the  network.  Por  instance,  the 
International  Standards  Drganization  adopted  a  "Reference 
Model  of  Open  System  Interconnection"  (ISD)  which  consists 
of  seven  layers  of  protocol.  The  different  layers  as 
described  by  Tanenbaua  [Ref.  1  ],  are;  physical  layer,  data 
link  layer,  network  layer,  transport  layer,  session  layer, 
presentation  layer  aid  application  layer.  Heritsch  rin 
Reference  [  2],  addresses  three  levels  of  protocol  which  are 
of  concern  in  studying  Distributed  Routing  Protocols.  Rive 
of  these  layers  are  incorporated  into  the  three  protocol 
levels  discussed  by  Heritsch.  The  interrelation  of  these 
levels  and  layers  is  presented  in  the  following  paragraphs. 
Two  layers,  the  session  layer  and  the  appi:'. cation  layer,  are 
net  considered  since  they  are  not  present  in  the  the  test 
networks  used  in  this  study. 
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The  lowest  level  of  protocol  is  called  the  Sode-to- Node 
protocol  and  consists  of  those  instructions  necessary  to 
ascertain  and  verify  that  a  usable  communications  path 
exists  between  any  two  adjacent  nodes.  This  level  is  a 
combination  of  the  physical  layer  and  the  data  link  layer  of 
the  ISO  and  serves  to  establish  the  physical  exchange  of 
data  between  nodes.  In  addition  the  Node  to  Node  protocol 
specifies  the  "handsnake"  and  "acknowledgement'1  processes 
which  are  required  whenever  messages  transit  between  two 
neighboring  nodes.  (The  term  "neighboring  nodes"  implies 
that  a  direct  two  way  communications  path  exists  between 
adjacent  nodes.  Such  a  path  is  referred  to  as  a  "link".) 
If  the  computer  software  within  the  node  is  configured  to 
monitor  the  transmission  and  receipt  of  Node  to  Node 
protocol  messages,  then  the  continuing  function  of  verifying 
that  a  usable  link  exists  can  be  accomplished  without 
another  form  of  protocol  message  being  entered  into  the 
network. 

The  next  level  of  protocol  is  '■he  Network  Management 
Protocol  which  corresponds  directly  to  tns  network  layer  of 
the  ISO  and  exchanges  all  the  information  necessary  for  the 
nodes  to  make  decisions  as  to  which  route  each  aessaae 
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originated  ty  or  relayed  by  tbs  node  should  travel  enroute 
to  its  destination.  There  are  several  different  concepts  of 
Network  Management  protocol.  Since  if  the  amount  of 
Network  Management  traffic  is  large  there  is  less  residual 
capacity  in  the  network  for  the  transmission  of  user 

generated  traffic,  it  is  essential  to  establish  an 
understanding  of  the  portion  of  to*al  network  capacity 
required  to  implement  a  given  Network  Management  Protocol. 
This  study  is  concerned  with  developing  such  an 

understanding  for  the  Network  Management  Protocol  proposed 
by  Heritsch  [Ref.  2]. 

The  final  level  of  protocol  is  the  User  Service 
Protocol.  This  level  is  equivalent  to  the  presentation 
layer  cf  the  ISO.  As  the  name  implies,  this  level  is 

concerned  with  the  interface  between  the  user  and  the 

communications  network.  Functions  accomplished  by  this 
protocol  level  may  include  the  automatic  breakdown  of  user 
messages  info  "packets'1,  attaching  accounting  numbers  to  the 
messages  and  releasing  or  receiving  messages  into  and  from 
the  network.  At  this  level,  tradeoffs  made  between  network 
transparency  and  the  required  user  interaction  with  the 
network  are  most  apparent. 
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C.  DISTRIB  OTE  0  ROOTISG  PR  OTOGDLS 


The  singular  feature  which  distinguishes  a  packet 

switching  communications  network  from  other  communicat ions 
networks  is  the  reparkaging  of  user  messages  into  saaller 
fixed  length  "packets",  each  of  which  can  be  treated 
separately  by  the  network.  \n  advantage  of  using  fixed 
length  packets  is  that  the  network  can  seek  to  transmit 
packets  via  routes  waich  currently  have  the  fewest  number  of 
packets  flowing  through  them.  Since  ail  packets  are  the 
same  length  a  simple  count  of  the  number  of  packets  waiting 
in  queue  for  a  specific  link  is  a  measure  of  the  delivery 
delay  a  packet  traveling  that  route  would  experience.  The 
packet  switching  network  attempts  to  minimize  the  delay  time 
by  routing  packets  over  links  which  have  the  fewest  number 
of  packets  active  within  them.  It  is  desirable  to  use 

Distributed  Routing  Protocols  in  packet  switching  networks 
xc  decide  which  routes  are  shortest. 

Distributed  Routing  Protocols  are  sets  of  instructions 
utilized  by  the  network  to  determine  on  the  basis  of 

information  exchanged  with  its  neighbors  which  path  each 
packet  should  take  from  its  originating  node  to  its 

destination  node.  Distribute!  Routing  Protocols  may  be 
either  synchronous  or  asynchronous  in  design. 
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Synchronous  Distributed  Routing  Protocols  cause  all 
nodes  within  the  network  to  change  their  routing 
instructions  simultaneously  and  at  periodic  intervals. 
Asynchronous  Distributed  Routing  Protocols  permit  the  nodes 
to  adopt  new  routing  instructions  independently  whenever  the 
node  finds  a  path  to  the  destination  node  which  is  shorter 
than  the  path  it  had  previously  been  using. 

This  study  examines  the  Distributed  Routing  Protocol 
proposed  by  Heritsch,  [Ref.  2],  determining  its  performance 
ir.  both  the  synchronous  and  asynchronous  forms  and  comparing 
its  performance  to  the  centralized  routing  protocol  based 
upon  the  Djikstra  shortest  distance  algorithm  [Ref.  3].  The 
protocols  are  examined  using  a  computer  simulation  which 
uses  several  different  networks  and  several  levels  of 
network  message  loading  to  provide  an  indication  of  protocol 
performance  under  a  /ariecy  of  conditions. 
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II 


A  NAVAL  APPLICATION 


The  concept  of  packet  switching  offers  several 

advantages  to  users  who  require  high  data  rate  transmission 
capability  and  a  robust  communications  network  through  which 
large  volumes  of  message  traffic  must  pass.  In  particular 
the  requirements  of  the  Navy  Tactical  Data  System  (NTDS) 
might  in  the  future  be  met  utilizing  a  packet  switching 
network. 

NTDS  is  a  computer  based  tactical  information  display 
and  decision  system  .  NTDS  information  is  exchanged  between 
units  of  the  fleet  via  a  radio  frequency  digital 

communicat ions  network.  (The  term  "fleet"  is  used  here  in 
its  broadest  sense  and  may  include  such  diverse  units  as 

ships  ,  all  types  of  aircraft  and  troops  ashore.)  In  its 

present  form,  the  NTDS  utilizes  a  centralized  communications 
network  with  a  net  control  station  (master  node) 
coordinating  the  exchange  of  information  between  units  of 
the  fleet.  Participating  fleet  units  (nodes)  which  have 
direct  links  with  the  originating  node  (ie.  are  within  radio 
reception  range)  receive  the  transmitted  message.  Nodes 
which  are  beyond  the  radio  transmission  range  must  rely  on 
retransmission  of  the  information  by  a  node  which  is 


directly  linked  to  a  sending  nods.  Nodes  which  retransmit 
messages  may  be  thought  of  as  sub  level  master  nodes  and 
their  loss  may  deprive  outlying  nodes  of  information  and 
direct  io  n. 

In  contrast,  ths  packet  switching  concept  offers  a 
distributed  communications  network  to  support  the 
information  and  coordination  requirements  of  a  widely 
dispersed  fleet.  By  employing  a  Distributed  Pouting 

Protocol,  a  packet  switching  network  can  achieve  increased 
network  robustness  by  decentralizing  the  control  of  the 
network  and  seeking  to  optimize  the  routing  of  each  message 
entered  into  the  network.  An  NTDS  participant  would  enter 
information  into  the  communication  network  addressed  to 
other  NTDS  participants  as  required.  Upon  entry  the 
information  would  be  reformatted  into  "packets"  and 
transmitted  along  the  best  path  to  the  destination  nodes. 
Since  all  nodes  are  constantly  "updating"  their  status  and 
the  status  of  their  connecting  links  to  other  nodes  in  the 
network,  the  best  path  between  any  two  nodes  can  be 
autonomously  and  continuously  determined  oy  each  individual 
node  using  the  network's  J istrio uted  Routing  Protocol.  The 
loss  of  nodes  or  degradation  of  links  within  the  network 
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becomes  known  to  all  nodes  and  bast  paths  can  be  reevaluated 
such  that  the  network  can  continue  to  pass  messages  as  long 
as  possible.  This  feature  of  a  packet  switching  network 
derives  not  from  the  physical  addition  of  links  between 
nodes  but  from  considering  of  all  nodes  and  links  within  the 
network  as  potential  transmission  paths  to  any  other  node  in 
the  network. 

An  important  result  of  the  packet  switching  concept  is 
its  ability  to  automatically  relay  messages  to  nodes  which 
are  beyond  the  radio  recaption  range  of  the  sending  node. 
Since  the  sending  node  provides  the  destination  addresses  at 
the  time  of  message  transmission,  the  network  can  assume 
responsibility  for  delivery  of  the  message  rather  than  the 
conventional  method  of  broadcasting  a  message  and 
maintaining  the  receiving  nodes  within  direct  radio 
reception  range.  This  capability  would  allow  widely 
dispersed  nodes  to  enjoy  the  information  and  coordination 
advantages  of  the  SIDS  without  the  burden  of  additional 
radio  circuits.  Additionally,  the  packet  switching  concept 
is  adaptable  to  a  variety  of  Anti-Jan  (AJ)  and  Low 
Probability  of  Intercept  (LPI)  communications  schemes  which 
are  under  study  or  development  oy  the  Department  of  Defense. 
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In  particular,  packet  switching  is  ideally  suited  for  use 
with  several  spread  spectrum  communication  schemes. 

Conceptually,  the  most  difficult  problem  to  be  overcome 
in  the  deployment  of  packet  switching  networks  afloat  is  the 
mutual  interference  which  two  nodes  transmitting 
simultaneously  in  the  same  fregiency  band  might  cause  at  the 
receiving  ncde.  This  difficulty  could  be  overcome  using  a 
"carrier  sense”  or  a  "listen  before  transmit"  approach  in 
the  transmitter/receiver  design  and  employing  a  signalling 
scheme  which  permits  the  receiver  to  "lock  up"  on  the  first 
signal  received  to  the  exclusion  of  all  other  signals. 
Conceivably,  'units  could  operate  at  slightly  different 
carrier  frequencies  and  the  receivers  wculd  automatically 
shift  their  intermediate  frequency  sections  to  "lock  up"  cn 
the  sending  unit’s  carrier.  Mutual  interference  effects  can 
also  be  ameliorated  by  use  of  wide-ba.nd  psuedo-noise 
transmissions  using  uncorrelated  keystreams. 

It  is  with  the  possibility  in  mind,  that  the  packet 
switching  concept  could  improve  the  usability  and 
survivability  of  NTD5 ,  that  this  study  was  undertaken.  To 
this  end  a  set  of  generalized  network  configurations  were 
developed  so  that  several  performance  characteristics  of  the 
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•  IJklMSTERS  OP  A  PACKET  SWITCHING  NETWORK 

A.  QOANTI F YING  PROTOCOL  PERFORHANCE 

Critical  to  determining  the  relative  performance  of 
different  routing  protocols  operating  within  a  packet 
switching  network,  is  the  determination  of  an  expression 
(mathematical  or  otherwise)  which  provides  an  unbiased  and 
meaningful  basis  for  comparison.  In  this  study  the  average 
delay  time  in  delivering  a  packet  (Tp  )  is  used  as  one 
measurement  of  protocol  perf ornance.  Another  measure  of 
performance  used  is  the  utilization  factor  of  the 
network  (p).  A  mathematical  derivation  of  the 

inter-relation  of  these  terms,  based  upon  queueing  theory, 
is  presented  in  Appendix  A. 

The  average  time  delay  per  packet,  (Tp)  has  the 
advantage  of  relating  network  congestion  to  network  loading 
in  terms  of  delay  time,  which  is  ultimately  the  most 
meaningful  statistic  to  the  network  users.  The  utilization 
factor  provides  a  measure  cf  the  fraction  of  the  capacity  of 
the  network  which  is  required  to  transmit  user  messages 
(packets)  or  network  management  messages  (updates)  given  a 
specified  network  and  traffic  loading  for  the  network.  3oth 
of  these  measures  are  affected  by  several  physical 
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parameters  of  the  network.  For  instance  the  processing  time 
within  a  node  for  a  packet  adds  delay  time  to  the  packet 
which  is  proportional  only  to  the  number  of  nodes  traversed 
by  the  message  route,  hence  independent  of  the  routing 
protocol  in  use.  On  the  other  hand,  if  a  packet  must  wait 
in  a  queue  for  an  update  to  be  transmitted  on  a  link  then 
the  incurred  delay  is  of  interest  because  it  represents 
interference  by  network  management  traffic  with  the 
transmission  of  user  message  traffic.  A  discussion  of  the 
various  network  parameters  and  their  impact  on  the 
comparison  measures,  average  delay  per  packet  and  update 
utilization  factor,  is  presented  in  the  next  section. 

B.  NETWORK  CONFIGURAT IONS 

In  order  to  ensure  that  the  performance  measures  ”Tp  " 
and  "p"  obtained  from  the  simulation  of  the  network  are 
accurate,  it  is  necessary  to  determine  which  physical 
characteristics  of  the  network  effect  the  measures  of 
protocol  performance.  By  fixing  these  characteristics  as 
constants  for  all  the  networks  under  consideration,  it  is 
possible  to  obtain  measures  of  performance  which  are 
representative  cf  the  protocol’s  performance  in  networks  of 
varying  complexity  and  traffic  loading  conditions.  The 
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network  characteristics  which  ware  deemed  to  be  significant 
and  the  values  assigned  to  then  are  listed  in  Table  I  and 
are  discussed  in  the  paragraphs  that  follow. 

TABLE  I 

Significant  Network  Characteristics 


■ 

Parameter 

Value 

A 

packet  transmission  time  for  any  link 

packet  processing  time  in  any  node 

0.05  sec. 

0.0001  sec. 

« 

update  transmission  time  for  any  node 

update  processing  time  in  any  node 
update  cycle  time 

update  channel  value  calculation  window 

0.02  sec. 

0.00001  sec 

0.2  sec. 

0.5  sec. 

'( 

number  cf  nodes  in  the  network 

number  cf  links  in  the  network 

variabl e 

variaol e 

1 

average  number  of  packets  per  user  message 

average  number  of  user  messages  per  sec. 

variable 

variabl e 

simulation  run  time 

30  sec. 

The  packer  transai  ssior.  time  is  related  to  the  length  of 
the  packet  and  the  data  transmission  capacity  of  the  link 
over  which  it  is  to  travel.  for  this  study  only  two  types 
of  messages  (updates  and  user  messages)  are  allowed  to  enter 
the  links.  (Jser  messages  are  subdivided  into  packets  which 
are  fixed  in  sice  to  he  2.5  times  longer  than  an  npda'e 
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message.  In  tms  way  the  length  of  an  update  is  made  to  be 
small  compared  to  the  length  of  the  packet.  This  action 
appears  reasonable  in  view  of  the  significantly  smaller 
information  content  in  an  update  versus  a  packet.  The 
relative  length  of  the  the  updates  is  also  important  to  the 
performance  of  the  distributed  routing  algorithm  when 
computing  channel  values  which  are  discussed  in  section  C  of 
this  chapter.  The  time  of  3.35  seconds  selected  for  the 
transmission  time  of  a  packet,  is  equivalent  to  a  packet 
length  of  800  bits  transmitted  over  a  link  with  a  capacity 
of  16,000  bits  per  second.  Mternati vely,  it  equates  to  a 
120  bit  packet  transmitted  over  a  link  with  a  capacity  of 
2,400  bits  per  second. 

The  time  required  to  process  a  packet  within  a  node  was 
arbitrariy  chosen  to  be  0.0331  second  and  the  processing 
time  for  an  update  was  set  to  be  one  tenth  of  the  packet 
processing  time.  This  assignment  also  appears  reasonable 
since  in  processing  a  pacxst  each  node  must  read  the 
complete  address  section  of  earn  racket  to  determine  onward 
routing  if  required  and  prepare  a  new  address  section  for 
each  packet  which  is  retransmitted.  Or.  t.ne  other  hand,  ar. 
update  message  contains  orly  a  relatively  small  amount  of 
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information  which  is  either  discarded  or  storad  and  relayed 
as  required. 

The  update  cycle  time  represents  the  frequency  with 
which  the  network  establishes  a  new  best  path  for  routing 
packets.  An  asyncaconously  operating  protocol  does  not 
implement  best  paths  simultaneously  throughout  the  network 
but  rather  each  node  implements  a  new  best  path  immediately 
upon  determining  that  a  new  best  path  exists.  However,  if  a 
distributed  routing  algorithm  is  implemented  synchronously, 
it  is  necessary  for  the  update  message  to  have  reached  all 
the  destinations  before  a  new  routing  scheme  is  established 
in  the  network.  Aa  update  cycle  consists  of  two  equal 
length  time  periods.  During  the  first  period  nodes  generate 
the  required  update  messages,  which  receive  transmission 
priority  over  packets.  During  the  second  period  nodes 
receive  and  relay  update  messages  as  required.  Nodes  are 
restricted  from  generating  update  messages  during  the  second 
half  of  *:he  update  cycle  in  order  to  allow  the  updates  to 
suffuse  throughout  tie  network.  If  the  nodes  were  an 
average  cf  16.4  kilometers  (13  miles)  apart  and  a  maximum  of 
5  relays  were  required  for  each  update  to  reach  the 
destination  node  most  distant  from  it,  taen  the  maximum  time 
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required  for  an  update  to  reach  its  destination  can  be 
computed  as 

time  required  =  travel  time  ♦  processing  time 

♦  transmission  time 

which  becomes 

15.4  km 

t  =  5  * -  +  5  *  0.00001  ♦  5  *  0.002 

3  *  10**5  km  /  sac 

or 

t  =  .025  sec. 

which  is  well  within  the  available  0.1  seconds.  Note  that 
this  result  implies  that  for  applications  where  the  nodes 
are  close  (in  relation  to  signal  travel  time)  then  the 
prcpogation  time  is  insignificant  compared  to  the  time 
required  to  Drocess  an  update  through  a  node.  3y  choosing 
ar.  update  cycle  time  of  0.2  second  the  network 
configurations  used  in  the  simulation  could  be  considered 
representative  of  real  world  networks  whicn  have  longer  link 
lengths  and/or  a  greater  number  of  relays  required  for  the 
delivery  of  an  update  message. 

It  is  the  complexity  of  the  network  which  has  the  most 
potential  for  impacting  on  the  performance  of  a  Discriouoed 
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Souting  Protocol,  and  it  is  therefore  important  to  consider 
how  the  topology  of  the  network  interacts  with  the  protocol. 
The  number  of  nodes  in  a  network  determines  the  number  of 
update  messages  which  must  be  generated  during  each  update 
cycle,  which  translates  into  an  increasing  requirement  for 
network  capacity  to  pass  updates  as  the  number  of  nodes 
increases.  This  results  in  Less  network  capacity  available 
for  the  transmission  of  user  messages.  The  number  of  links 
in  a  network  is  also  important  since  it  determines  the 
capacity  of  the  network  both  for  message  ani  update  traffic. 

Traffic  loading  is  another  network  parameter  which  may 
affect  the  performance  of  a  Distributed  Routing  Protocol. 
For  a  packet  switching  network  the  traffic  loading  is 
controlled  by  three  factors,  the  number  of  user  messages 
entering  the  network  per  unit  time  and  the  length  of  the 
messages  and  the  distribution  cf  the  originator  and 
destination  addresses  of  each  message.  Since  messages  are 
decomposed  into  fixed  length  packets,  this  last  factor  is 
the  same  as  the  number  of  packets  in  a  user  message. 

In  a  real  world  network  each  of  these  parameters  is 
random  and  if  is  common  in  iieueing  theory  to  assign  a 
distr ibutio n  to  the  fr equer.o y  with  which  messages  are 


entered  into  the  network  and  the  number  of  packets  into 
which  a  message  is  decomposed  in  terms  of  a  probability 
distribution.  It  is  often  assumed  that  generation  of 
messages  into  a  network  can  be  represented  by  an  exponential 
distribution  and  that  the  number  of  packets  in  a  message  can 
be  represented  as  a  uniform  distribution.  Two  mean  values 
of  packet  distribution  were  used  in  this  study  (5.5  and  10.5 
packets  per  message)  so  that  the  effects,  if  any,  of  the 
length  of  the  messages  on  the  performance  of  the  protocols 
could  be  determined. 

A  final  factor  wn ich  may  affect  the  performance  of  a 
Distributed  aouting  Protocol  is  the  simulation  rur.  time.  If 
the  complete  network  is  considered  to  be  a  system  and  the 
first  message  into  the  system  is  viewed  as  an  impulse  input 
into  the  system  then  it  is  clear  that  the  system  will 


undergo  some 

period  of 

transit 

ion 

between  the  dormant 

condition  (ie. 

no  inputs) 

and 

its 

equilibrium  operating 

state.  The 

length  of 

this 

trans 

ition  phase  can  be 

determined  mathematically  for  tie  probabalistic  case  of  a 
communications  network  only  with  difficulty.  However,  by 
observing  the  resuLts  of  the  network  simulation  after 
several  different  simulation  run  times  it  was  determined 
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that  a  run  tine  of  33  seconds  allowed  the  transition  phase 
to  be  completed  and  provided  a  period  of  steady  state 
operation  long  enough  so  that  meaningful  data  could  be 
taken. 

A  total  of  four  networks  were  generated  for  use  in  this 
study.  A  diagram  of  each  network  is  provided  in  Appendix  B. 
The  number  cf  nodes  in  each  network  varied  between  5  and  20 
and  the  number  of  links  varied  between  10  and  40.  To  reduce 
distortion  cf  the  simulation  results  which  could  be  caused 
by  different  network  topologies,  a  base  network  cf  5  nodes 
and  10  links  was  adopted.  By  expanding  the  base  network  in 
a  consistent  manner,  valid  comparisons  between  the 
performance  of  a  protocol  and  network  complexity  could  be 
drawn.  Mora  complex  networks  were  created  by  expanding  the 
link/node  structure  of  the  base  network.  The  chosen  base 
network  is  illustrated  in  Figure  3.1  and  consists  of  five’ 
nodes  and  ten  links. 

To  provide  a  convenient  method  of  referencing  the 
networks  the  notation  "5/13"  has  been  adopted  to  denote  a  5 
node  and  10  link  network.  The  5/10  network  was  expanded  in 
tc  a  10/20  network  ov  adding  an  additional  5  nodes  and  10 
links.  Similarly,  a  15/30  and  20/40  network  were  derived. 
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Fig.  3.1.  The  5/10l  Network. 


Note  that  each  succeeding  network  contains  the  proceeding 
network. 


C.  CHANNEL  VALUES 

As  described  in  section  3  of  this  chapter,  the  channel 
values  ("link  distances"  in  sons  literature)  are  computed 
during  the  update  window  time  and  represent  the  current 
demand  for  a  particular  link's  services  as  a  relay  path. 
The  channel  value  also  represents  a  prediction  cf  the  demand 
or.  a  particular  link  during  tr.e  upcoming  update  cycle.  2y 
using  these  channel  values  it  is  possible  to  determine  a 
path  between  any  two  nodes  which  will  have  the  lowest 
cumulative  channel  value  (ie.  tne  best  path  during  the  next 


update  cycle)  .  It  is  ‘ha  function 


tne  ustrih  urea 


transmit  and  evaluate  the 


routing  protocol  to  generate, 
channel  values  and  establish  best  paths  within  the  network. 
To  accomplish  this  task  the  protocol  generates  update 
messages  which  contaia  channel  value  information.  The  exact 
content,  method  of  relay  and  method  of  evaluating  the  update 
message  is  unique  to  each  protocol. 

The  method  of  aeaerating  channel  values  for  both  the 
Her its ch  and  Djikstra  algorithms  as  implemented  in  this 
study  is  identical,  and  a  complete  description  can  be  found 


ir.  Heritsch  [Ref.  2]. 

In 

short,  the 

channel  value 

represen ts 

the  average 

numbe 

r  of  packets 

waiting  in  the 

queue  to  be 

transmitt  ed 

over 

the  link  duri 

ng  the  preceding 

0.5  second  of  simulation  time. 
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TWD  DI STRiaOJBD  ROUTING  PROTOCOLS 


A.  THE  HER  ITSCH  ALGORITHM 

Heritsch  proposal  ia  Reference  [2],  a  Distributed 
Routing  Protocol  which  seeks  to  minimize  the  number  of 
update  messages  required  to  be  circulated  througout  a 
network  during  a  single  update  cycle.  Update  messages  in 
the  Heritsch  algorithm  certain  three  items  of  information: 
the  node  which  just  relayed  the  update,  the  node  which 
originated  the  update  and  the  cummulative  channel  value 
from  the  node  which  just  received  the  update  to  the  node 
which  originated  the  update,  through  the  node  which  relayed 
the  update.  Thus  each  node  receiving  an  update  can  compare 
the  cummulative  channel  value  through  the  relaying  node  to 
the  cummulative  channel  value  of  the  path  over  which  it  is 
currently  passing  packets  to  the  node  which  originated  the 
Update.  If  the  new  channel  value  in  the  .most  recent  update 
is  less,  a  new  best  path  to  the  node  which  originated  the 
update  is  adopted  through  the  node  which  relayed  the  update. 
In  any  event,  the  node  which  just  received  the  update  now 
generates  an  update  message  to  all  of  its  neighbor  nodes 
(less  the  node  which  relayed  the  update  that  started  it 
all),  and  informs  all  the  nsiahboring  nodes  of  the  new 
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cummulative  channel  value.  rhese  nodes  in  turn  repeat  the 
process  of  evaluting  the  information  contained  in  the 
update,  establishing  new  best  paths  if  the  minimum 
cummulative  channel  value  changes. 

If  no  new  best  path  is  adopted  and  the  channel  value 
through  the  current  best  path  has  not  changed,  the  node 
discards  the  update  without  relaying  the  information  it 
contained.  Since  nodes  which  are  ‘'upstream"  from  the  node 
which  received  the  update  do  not  change  their  best  paths 
unless  the  best  path  "downstream"  changes,  there  is  no 
reason  to  relay  the  update  further  through  the  network. 
Note  that  even  if  a  new  best  oa^h  is  not  adopted  but  the 
channel  value  changes  over  the  current  best  path,  this 
information  must  be  relayed  "upstream"  since  it  may  affect 
the  best  path  decisions  of  "upstream"  nodes.  What  is 
significant  is  that  the  algorithm  purges  update  messages 
from  the  network  at  the  first  opportunity  and  thus  releases 
channel  capacity  to  the  network  for  the  relay  of  packets. 

The  disadvantage  of  the  algorithm  is  that  it  does  not 
guarantee  optimum  routing  for  each  packet  released  into  the 
network.  It  is  possible  for  a  packet  to  loop  through 
several  nodes  before  being  delivered  to  its  final 
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destination.  This  looping  is  the  result  of  a  packet 
following  a  best  path  which  is  changed  more  than  once  during 
the  transit  of  the  packet  through  the  network. 

The  basic  algorithm  as  stated  above  is  substantially 
identical  to  the  routing  procedure  originally  used  in  the 
ARPANET.  The  major  innovation  proposed  by  Heritsch  is  that 
the  number  of  update  messages  required  in  a  given  network 
could  be  reduced  if  the  network  was  subdivided  into  nodal 
colonies  which  are  called  groups  and  families.  A  group  can 
be  defined  as  a  collection  of  nodes  and  a  family  is  a 
collection  of  groups.  By  treating  the  groups  and  families 
of  nodes  as  "super  nodes"  it  may  be  possible  to 
significantly  reduce  the  number  of  update  messages  required 
to  implement  the  protocol.  Tois  reduction  is  accomplished 
by  restricting  the  propagation  of  the  update  message  to  the 
basic  group  of  the  node  which  originates  the  update.  Nodes 
which  are  connected  to  other  groups  or  families  originate 
updates  which  reflect  the  cummuiative  channel  values  from 
that  node  into  the  neighboring  family  or  group.  Thc  result 
is  that  all  nodes  within  a  basic  group  ran  determine  the 
best  path  to  any  other  group  or  family  and  are  not  required 
to  determine  best  paths  to  all  other  nodes  in  the  network. 
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Thus  a  packet  generated  in  one  group  would  travel  the  best 
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path  to  the  destination  group  and  or.ce  it  reachs  the 

destination  group  reoeive  onward  routing  to  the  destination 
node. 

The  Eieritsch  algorithm  may  be  implemented  either 

synchronously  or  asynchronously  in  a  packet  switching 

network.  Since  the  algorithm  allows  each  node  to 

autonomously  determine  new  best  paths  it  is  possible  to 

■ 

implement  new  best  paths  whenever  an  update  is  received 
ran her  than  adopting  best  paths  in  synchronism  with  all  the 
other  nodes  in  the  network.  The  only  constraints  to  the 

algorithm  are  that  update  message  generation  be  restrained 
tc  a  fixed  time  interval  so  that  update  messages  are  able  to 
reach  their  "final"  destinations  before  a  new  update 
generation  cycle  starts. 

A  comparison  of  the  algorithm's  performance  when 

imolemented  both  synchronously  and  asynchronously  in 

identical  networks  was  accomplished  as  part  of  this  study. 
No  significant  difference  was  found  to  exist  in  the 
performance  of  the  protocol  under  the  two  implementators . 

From  the  viewpoint  of  network  roousrness,  it  is 
desirable  to  impienert  the  algorithm  asynchronously. 
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However,  for  purposes  of  comparison  with  the  Djikstra 
algorithm,  (which  can  only  bs  implemented  synchronously)  , 
the  Heritsch  algorithm  was  restricted  to  the  its  synchronous 
implementat  ion. 

B.  THE  DJIKSTRA  ALGORITHM 

The  algorithm  proposed  by  E.  Djikstra  in  Reference  [3] 
is  used  in  the  currant  ARPANET  routing  protocol,  which 
requires  that  each  node  within  the  network  receive  the 
channel  value  for  each  link  in  the  network  before  a  new  best 
path  is  determined.  The  protocol  causes  each  node  to 
generate  an  update  which  contains  the  channel  value  from  the 


originating 

node  to 

each  of  the  originating 

no 

de '  s 

neighbors. 
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in 
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network  and 

each  node 
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manipulated  in  such  a  way  that 
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each  node  to  each  other  node 
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the 

network. 

The  Djikst 

ra  algorithm  may  also  be  aaap 

ted 

to 

utilize  the  group  and  family  scheme  proposed  by  Heritsch. 
An  examination  of  the  Djikstra  algorithm's  performance  using 
a  group  and/or  family  configured  network  was  not  conducted 
as  a  part  of  this  study. 
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The  significant  differences  between  the  two  protocols 
are  the  number  of  update  messages  required  to  implement  each 
protocol  and  the  "quality1’  if  the  best  path  which  is 
determined  by  each  algorithm.  The  Djikstra  algorithm 
provides  an  optimum  quasi-static  best  path  for  each  packet 
released  into  the  network.  That  is  to  say,  each  node  ir. 
turn  routes  the  message  to  the  next  relay  node  along  the 
best  oath  in  accordance  with  the  Djikstra  algorithm  which  is 
guaranteed  to  produce  a  minimum  distance  route.  Similarly, 
in  the  Heritsch  algorithm  each  packet  is  addressed  to  the 
next  node  along  its  estimated  oast  path,  but  there  is  no 
guarantee  that  this  estimated  path  is  indeed  the  optimum 
path.  With  regard  to  the  number  of  update  messages  required 
by  each  algorithm,  at  first  glance  it  would  appear  that  the 
Djikstra  network  requires  an  inordinate  amount  of  network 
capacity  to  pass  updates  through  the  network.  The  situation 
is  not  this  bad  however,  since  update  messages  which  would 
travel  along  the  same  best  path  to  their  destination  can  be 
combined  to  reduce  the  total  number  of  update  messages 
required. 

The  matrix  manipulation  required  by  the  Djikstra 
algorithm  to  determine  the  best  paths  is  accomplished  in  the 
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following  manner.  If  the  5/7  network  illustrated  m  Figure 
4.1  is  considered  as  an  example  then  the  channel  values 
between  adjoining  nodes  may  be  represented  by  the  symbols  7> 
or  <5,  where  the  arrowhead  indicates  the  direction  of  the 
channel  value  and  the  number  indicates  some  relative  measure 
of  the  channel  values  as  they  might  appear  at  the  start  of 
any  update  cycle. 


Fig.  4.1.  A  5/7  Network 


From  this  network  the  matrix  in  Figure  h.2  is  constructed. 
No~e  that  nodes  wnirn  have  no  direct  link  between  them  are 
initially  represented  at  the  start  of  every  cycle  as  having 
an  infinite  channel  value  between  them. 

Beginning  with  node  A,  observe  that  a  direct  linx  exists 
with  node  3  and  that  the  channel  value  from  node  A  to  node  5 


A/C/3/oo  ,  is  greater  Than  the  A/3/U  path  and  so  a  new  bes 
path  Through  node  o  is  rejected.  Next  the  A/D/2  ♦  D/3/>o 

A/D/3/oo  path  is  considered  and  also  rejected  as  a  new  bes 


path.  Finally,  tie  path  A/3/1  *  2/5/2  =  A/E/3/3  is 


considered  and  adopted  as  the  tentative  new  best  path  from 
node  A  to  node  B  since  the  resultant  cumulative  channel 
value  cf  3  is  less  naan  the  orsvicus  value  of  u. 


Similarly  the  channel  values  from  node  B  to  each  other 
node  are  coftsidered  and  tentative  best  paths  established. 
When  all  paths  between  nodes  of  the  network  are  evaluated 
and  tentative  best  paths  established  (ie.  the  matrix  is  run 
through  completely  one  time)  the  entire  process  is  repeated 
until  a  run  through  the  matrix  is  completed  with  no  new 
tentative  best  path  adopted.  When  this  occurs  the  best 
paths  within  the  matrix  are  aiopted  simultaneously  by  all 
nodes  of  the  network  for  the  iuration  of  the  next  update 
cycle  and  represent  the  optimum  paths  between  nodes. 

To 


C  I  4  3  -  6  5 

D  J  2  5  4  -  3 

E  |  3  2  1  4 

Fig.  4.3.  The  Completed  Best  Path  Matrix 

The  final  result  of  the  matrix  manipulation  for  the 
update  cycle  cor.siiered  in  this  example  is  shown  in  Figure 

4.  3. 
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S 1^3 L ATI ON  OP  THE  PROTOCOLS 


A.  PROGRAMMING  SCHEME 

The  simulation  programs  used  in  the  study  were  written 
in  the  SIMSCRIPT  II. 5  programing  language  [Ref.  4],  This 
language  provides  ai  excellent  vehicle  for  simulation  work 

in  which  many  events  may  occur  almost  simultaneously.  In 

addition,  the  ability  to  control  the  flow  of  the  simulation 
by  utilizing  a  language  generate!  simulation  clock,  provides 
the  user  with  a  means  of  obtaining  data  from  the  simulation 
at  various  times  without  regard  for  the  events  being 
processed. 

Three  simulation  programs  were  developed  from  the 

program  presented  by  Heritsch  in  Reference  [2].  The  three 
programs  are  listed  at  the  end  of  this  study  and  represent 
an  asynchronous  implementation  of  the  Heritsch  algorithm,  a 
synchronous  implementation  of  the  Heritsch  algorithm  and  a 
synchronous  implementation  of  tne  Djikstra  algorithm.  The 
program  lisitng  for  the  syncaronous  implementation  of  the 
Heritsch  algorithm  is  provided  in  Appendix  C.  Each 
simulation  is  constructed  in  modules  which  correspond  to  the 
different  functions  which  the  network  and  the  routing 
protocol  must  perform.  ?or  example,  each  simulation 
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contains  individual  subroutines  for  the  generation  of 
updates,  arrival  of  packets  within  a  node  and  the 
computation  of  channel  values.  A  listing  of  all  the  arrays 
used  within  the  programs  is  provided  in  Appendix  D  to  assist 
in  tracing  the  functional  composition  of  the  programs.  The 
parameters  of  the  network  under  consideration  are  externally 
input  into  the  simulation  as  a  data  set  which  is  read  by  the 
source  code  during  the  execution  of  the  simulation.  A 
sample  of  an  input  data  sat  is  listed  in  Appendix  E. 

The  results  of  the  simulations  can  be  output  in  several 
formats.  The  most  extensive  output  available  is  a  complete' 
listing  of  every  event  ocruring  during  the  simulation.  It 
is  possible  to  limit  the  output  to  only  the  desired  data  by 
specifying  the  desired  results  in  the  "Special  Output" 
subroutine  of  each  program.  The  simulation  programs  also 
feature  the  ability  to  make  any  number  of  simulation  runs 
with  various  input  parameters  during  a  single  job 


submission . 

In  addit  ion, 

the  results 

of  the  Simula hi 

on  can 

be  diverted 

to  either  mass 

storage  per 

ipheral  devices 

or  the 

normal  pri 

nter  output  or 

both.  A 

sample  of  the 

output 

format  used 

for  this  study 

is  provided 

in  Appendix  E. 
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The  implementation  of  the  packet  switching  network  is 
identical  in  all  the  simulation  programs.  Each  link  within 
the  network  is  "configured"  to  have  two  input  queues  (a 
packet  queue  and  an  update  queue).  Ho  queues  are 
constructed  for  the  input  side  of  each  node.  Nodes  are 
required  to  give  priority  to  the  transmission  of  updates 
over  packets  as  would  be  requited  in  a  real  world  network. 
Update  messages  are  generated  only  iuring  tha  first  half  of 
the  update  cycle.  The  precise  time  at  which  each  node 
generates  its  update  massage  is  uniformly  distributed 
throughout  the  first  half  of  the  update  cycle.  User 
messages  are  generated  into  the  network  at  time  intervals 
which  are  exponentially  distributed.  The  originating  node 


and  destination 

node  of 

the 

message  and  the 

number  of 

packets  in  the 

message 

are 

determined  using 

uniformly 

distributed  random  variables.  The  destination  node  of  a 
user  message  can  be  constrained  to  be  outside  the 
originating  node's  group  and/or  family  in  order  to  ensure 
that  a  specified  percentage  of  the  user  messages  are 
destined  for  other  groups  and/or  families. 
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B.  ARTIFICIALITIES  DF  THE  SIMOLATION  PR03RAH 

Several  artificialities  were  introduced  into  the 
simulation  programs  in  order  to  reduce  computer  run  time  and 
program  complexity.  The  most  significant  of  these  is  the 
assumption  that  each  node  has  a  processor  dedicated  to  each 
link  entering  the  node.  This  implies  that  the  node  can 
simultaneously  receive  and  process  inputs  on  all  of  its 
links.  While  the  capability  of  parallel  processing  is 
desirable  in  a  packet  switching  network,  it  is  not  a 
requirement  and  may  be  replaced  by  employing  a 
"listen-bef ore-transai t"  and  " r eceiver-lock-up"  node  design, 
in  which  each  node  can  communicate  with  only  one  other  node 
at  a  time.  In  either  case  the  maximum  throughput  of  any 
node  is  considered  to  be  determined  by  the  output  capacity 
of  the  node  and  not  its  input  capacity.  Thus  the  absence  of 
input  queues  in  the  simulation  is  considered  reasonable. 


The 

s  i 

nuiation  also 

does 

not  consider 

the 

net  work 

capacity 

v  h 

ich  is  require 

d  to 

implement  the 

Node 

to  Node 

Protocol , 

which  is  vita 

1  to 

the  c Deration 

of  a 

pa  cket 

switching  network.  The  capacity  required  to  carry  the  Node 
to  Mode  protocol  nessages  is  relatively  insignificant 
compared  to  than  required  for  update  and  packet 
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transmissio  ns.  Since  this  study  is  concerned  only  with  the 
performance  of  the  routing  protocol,  the  network  capacity 
required  by  the  Node  to  Node  Protocol  is  disregarded. 


C.  LIMITATIONS  OF  THE  SIMULATION  PROGRAM 

The  detailed  results  of  the  simulations  depend 
substantially  on  the  "seed"  numbers  which  are  used  to 
initialize  the  random  number  streams  generated  internal  to 
the  SIMSCRIPT  language.  Since  the  random  number  streams  are 
used  to  determine  the  origination  node,  destination  node, 
time  of  message  origination  and  the  number  of  packets  in  a 
message,  the  simulation  will  provide  somewhat  different 
results  for  the  same  input  parameters  if  different  "seed" 
numbers  are  used.  The  variability  of  a  particular  result 
from  the  average  result  computed  from  several  different  runs 
of  the  simulation  using  the  same  inputs  but  different 
"seeds",  was  empirically  determined  to  be  on  tho  order  of  5 
percent  cf  the  average  result.  Thus,  although  the  graphical 
results  of  the  simulations  (Appendix  F)  appear  to  be 
discontinuous  in  nature  as  the  input  parameters  are  changed, 
it  is  expected  that  these  perturbations  are  due  to  the 
"randomness"  of  the  simulation.  If  a  sufficient  number  of 
simuia*ion  runs  were  made  for  each  data  point,  the  average 


of  these  points  would  be  expected  to  result  in  a  "smoother" 


c 


( 


1 


curve. 

D.  GENERATION  OF  DATA 

A  total  of  twelve  different  simulation  runs  were 
required  to  produce  the  results  presented  in  this  study. 
The  physical  parameters  of  the  networks  and  the  network 
loadings  were  selected  to  represent  the  most  critical  ar.d 
interesting  aspects  of  the  interaction  between  the  network 
and  the  routing  protocol  in  use.  The  Heritsch  algorithm  was 
synchronously  implemented  on  four  networks  (5/10,  10/20, 

15/30  and  20/40)  and  asynchronously  on  two  networks  (10/20 
ar.d  15/30).  The  algorithm  .  was  also  synchronously 
implemented  on  the  10/20  and  15/30  networks,  witr  the 
networks  divided  into  2  groups  of  5  nodes  and  3  groups  of  5 
nodes  respectively,  to  investigate  the  capacity  required  to 
implement  the  aiqorithm  in  a  multiple  group/family  network. 
Lastly,  the  Djikstra  algorithm  was  implemented  or.  the  5/10, 
10/20,  1 5/3 C  and  20/40  networks. 

The  graphs  cf  the  data  contained  in  Appendix  H  were 
derived  from  the  data  obtained  from  these  twelve  simulation 
runs  and  are  presented  in  two  forms.  The  first  group  of 
twelve  graphs  illustrates  for  each  network  and  each 


algorithm,  the  average  delivery  delay  per  packet  versus  the 
loading  of  the  network.  The  second  group  of  twelve  graphs 
shows  the  packet  and  update  utilization  factors  versus  the 
network  loading  for  each  algorithm  and  each  network.  The 
interpretation  of  the  data  presented  in  the  graphs  is 


provided  in  Chapter  71. 
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A.  RESULTS 

1.  Comparison  of  Average  Delivery  Delap 

The  average  delivery  ialay  for  a  packet  (T  p  )r  was 
computed  using  Equation  ( A— 1 2 1  from  Appendix  A.  This 
equation  uses  the  measured  utilization  factors  for  updates 
and  packets  (Pu,  and  pp  )  and  a  specified  network  loading 
(g)  to  compute  Tp  .  Although  the  aquation  does  not 
provide  an  absolute  measure  of  the  protocol's  performance  it 
is  useful  in  comparing  the  relative  performance  of  the 
Djikstra  algorithm  to  the  Heritsch  algorithm. 

Theoretically,  Tp  should  increase  dramatically  as  the 
network  loading  begins  to  approach  the  network  capacity. 
Figure  6.1  illustratas  the  general  fora  of  the  expected 
Tp  versus  g  results.  This  expected  result  reflects  the 
obvious  conclusion  that  the  delivery  delay  experienced  by  a 
packet  must  increase  without  bound  when  more  packets  are 
entering  the  network  per  second,  on  the  average,  than  can  be 
delivered  by  the  network  in  a  second. 

From  the  simulation  results  contained  in  Appendix  F, 
it  is  concluded  that  a  packet  switching  network  employing 


has  less  average 


delay  per  packe- 


he  Djikstra  algoritam 


delay  par  packet. 

One  curve  on. 

each 

graph 

represents  the 

results  of  Equation 

(A-  12) 

and 

the 

other 

represents  the 

average  actual  delay 

per 

packs  t 

which 

was 

computed  using 

measured  data  from  th 

a  simulation 

as  follows. 
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where 


(6-1) 


M  =  the  average  delay  per  packet  (measured) 

P 

t  =  the  sum  time  required  to  transit  the 
t  network  of  all  packets  which  reach 

their  final  destination 

k  »  the  total  number  of  packets  originated 
during  the  simulation  which  reach 
their  final  destination. 

Equation  (6-1)  provides  a  much  different  result  for 
the  average  delay  pec  packet  than  does  Equation  (A-12),  and 
both  of  these  methods  of  predicting  the  protocol  performance 
are  subject  to  considerable  inaccuracy  as  discussed  in  the 
following  paragraphs. 

As  noted  in  Appendix  A,  Equation  (A-12)  was  derived 
from  queueing  theory  results  which  apply  to  networks  with  a 
fixed  routing  and  an  exponential  service  time  distribution. 
Since  the  networks  under  study  nve  a  dynamic  routing  scheme 
and  a  fixed  service  time,  the  direct  transfer  of 
mathematical  analysis  from  one  application  to  the  other  has 
questionable  validity.  Adding  to  this  uncertainty  is  the 
priority  handling  of  update  messages  and  their  shorter 
service  time,  whin  was  factored  into  the  derivation 
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presented  in  appendix  A.  Finally,  some  error  in  the  results 
of  the  equation  is  expected  due  to  the  method* of  measuring 
the  utilization  factors.  Since  it  was  desirable  to  avoid 
including  the  transient  effects  of  initial  network  start-up, 
the  measurement  of  tie  utilization  factor  for  each  link  was 
limited  to  the  last  half  of  the  simulation.  To  accomplish 
this  restriction,  it  was  necessary  to  structure  the 
simulation  program  so  that  any  link  which  was  busy  at  the 
instant  of  "half  time"  was  identified  and  the  fixed  value  of 
0.05  seconds  {packet  transmission  time)  was  added  to  the 
busy  time  of  the  link  for  the  first  half  of  the  simulation. 
This  busy  time  was  then  subtracted  from  the  total  time  the 
link  was  busy  througaout  the  simulation.  The  end  result  was 
a  measured  utilization  factor  for  any  one  link  which  could 
be  or.  the  order  of  0.003  percent  smaller  than  the  actual 
value.  Despite  these  probable  inaccuracies,  the  results  of 
Equation  (A-12)  agree  with  the  intuitive  notion  that  the 
average  delay  per  packet  should  exhibit  a  dramatic  increase 
as  the  network  leading  approacr.es  the  network  capaci-y. 

In  a  network  with  fixed  routing  the  "break  point" 
for  the  rise  in.  delay  time  can  occur  at  moderate  network 
loads  if  a  critical  subset  of  links  is  saturated  (  ?  =  1.0) 


and  a  portion  of  the  nodes  are  effectively  Mcut-off"  from 
the  network.  The  rational  for  employing  a  dynamic  routing 
scheme  is  that  saturated  links  are  bypassed  (wherever 
possible)  until  their  utilization  factors  return  to  a  more 
normal  level.  The  effect  is  to  postpone  the  dramatic  rise 
ir.  network  delay  until  greater  network  loading  conditions 
are  experienced  by  tie  network.  Thus  a  whole  cutset  of  the 
network  (vice  only  a  few  links)  must  have  a  utilization 
factor  nearly  equal  to  unity  before  the  characteristic  delay 
curve  exhibits  its  predicted  rise. 

The  actual  measurement  of  the  average  delay  per 
packet  was  accomplished  by  accumulating  the  transit  time  of 
all  messages  which  reached  their  destination  ar.d  dividing  by 
the  number  of  messages  which  reached  their  destination. 
This  measure  does  not  include  a  method  of  determining  the 
delay  near  the  "break  point",  since  near  that  point  the 
number  of  messages  which  are  delivered  in  a  finite  time 
period  becomes  relatively  constant  regardless  of  the  network 
loading.  Thus  the  result  from  this  method  of  computing 
delay  does  not  exhibit  the  strong  non-linearity  of  Equation 
( A  —  1 2 )  in  regions  near  utilization  factors  equal  to  unity. 
Most  packet  are  not  delivered  under  these  circumstances,  but 
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accumulate  in  the  quau.es  instead.  If  a  correct  expression 
of  the  average  delay  per  packet  is  to  be  measured,  it  must 
account  for  the  future  ielay  which  queued  messages  will 
incur  as  they  ultimately  work  their  way  out  of  the  network. 
The  formulation  of  aa  expression  which  accurately  describes 
the  shape  o f  t he  delay  curve  in  its  entirety  (including  the 
"break  point")  proved  an  elusive  goal.  However,  it  can  be 
intuitively  argued  that  the  performance  of  the  protocol  in 
regions  near  p  =1.0  a ust  be  such  that  the  average  ielay  per 
packet  is  increasing  very  dramatically  as  the  network 
loading  approaches  cLose  to  tie  network  capacity.  This 
intuitive  argument  was  verified  by  running  the  simulation 
for  a  duration  of  greater  tiar.  1 8 Q  seconds  at  network 
loadings  which  produced  average  network  utilization  factors 
in  excess  of  0.996  percent.  Jnder  these  conditions  it  was 
found  that  the  average  delay  per  packet  did  exhibit  the 
expected  dramatic  increase.  (Note  that  this  delay  was 
evicer.-  only  after  relatively  long  simulation  run  times.) 

In  summary,  -he  taeoretical  ielay  carve  predicted  by 
Equation  ( A  —12)  does  net  accurately  predict  the  performance 
of  the  Distributed  Routing  Protocol  due  to  the  adaptive 
nature  of  the  protocol  and  the  finite  duration  of  the 
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measurement  period.  Further,  a  successful  mathematical 

model  for  predicting  the  measured  performance  of  the 
protocols  was  not  found. 

Lastly,  the  average  delivery  delay  which  resulting 
when  the  Heritsch  algorithm  was  implemented  in  a  test 
network  which  had  the  nodes  divided  into  groups  was 

investigated.  Although  the  average  delay  per  packet  was 
significantly  decreased  using  the  group/family  routing 

feature  of  the  Heritsch  algorithm,  for  the  small  networks 
studied  here  it  was  not  as  low  as  the  average  delay  per 
packet  experienced  in  a  single  group  network  of  the  same 
size  which  employed  the  Djikstra  algorithm.  It  is  believed 
that  more  significant  ana  favorable  results  will  be  achieved 
if  larger  networks  are  used  in  comparing  the  performance  cf 
the  Heritsch  algorithm  in  single  group  versus  multiple 
group/family  networks. 

2.  Upd atin g  Hegui rements  Versus  Network  Complexity 

The  inherent  disadvantage  in  using  Distributed 
Routing  Protocols  is  the  requirement  ■‘•o  utilize  a  portion  cf 
the  network's  capacity  to  support  the  updating  requirements 
of  the  protocol.  Naturally,  the  protocol  wnicr.  oroviaes  the 
most  optimum  routing  and  requires  the  least  network  rapacity 
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to  operate  is  the  most  desirable.  The  amount  of  network 
capacity  required  by  the  protocol  is  determined  by  the 
frequency  at  which  update  messages  are  generated  and  the 
number  of  nodes  by  which  each  update  must  be  received. 

It  was  determined,  during  the  course  of  this  study 
that  the  network  capacity  required  by  each  of  the  protocols 
under  consideration  is  a  nearly  constant  value  for  a  given 
network  and  did  not  depend,  to  any  great  extent,  on  the 
traffic  loading  of  the  network.  Table  II  contains  the 
average  update  utilization  factor  for  the  daritsch  algorithm 
(for  single  and  multiple  group  networks)  and  the  Djikstra 
algorithm  (for  single  group  networks  only).  No  data  was 
obtained  for  the  daritsch  nstwork  implemented  on  a  5/10  cr 
20/4  0  multiple  group  network. 

TABLE  II 

Update  Utilization  Factors 

Network  Heritsch  Heritsch  Djikstra 

(single  groupi  (multiple  groups)  (single  group) 


5/10 

.044 

*  *** 

.0  09 

10/20 

.085 

.  02  3  ( 2 ) 

.0  19 

15/30 

.139 

.04  1  (3) 

.023 

20/40 

.201 

*  *** 

.0  28 
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The  numbers  La  parenthesis  in  Table  II  indicate  the 
number  of  groups  into  which  the  network  under  consideration 
was  divided  and  the  values  shown  are  derived  from  a 
simulation  using  a  nan  of  5.5  packets  per  message  (values 
obtained  for  a  mean  of  13.5  packets  per  message  are 
identical)  .  The  data  in  Table  II  indicates  that  it  is  very 
desirable  to  divide  a  network  into  groups  and  families 
whenever  the  Heritsch  algorithm  is  employed  since  the  same 
order  of  routing  optimization  is  achieved  with  a  significant 
reduction  in  the  network  capacity  required  to  support  the 
protocol. 

A  significant  result  is  that  for  small  networks  the 
Djikstra  algorithm  requires  less  network  napactiy  than  does 
the  Heri‘sch  algorithm  regardless  of  how  the  network  is 
structured  for  the  Heritsch  algorithm.  Hhile  this  result 
may  appear  startling  given  that  the  Heritsch  algorithm 
purges  updates  from  the  network  which  are  not  required  to  be 
retransmitted,  it  must  be  remembered  that  the  Heritsch 
algorithm  also  requires  all  "upstream"  nodes  to  ce  notified 
whenever  a  new  best  path  is  adopted  or  a  channel  value  is 
changed.  This  requirement  causes  the  generation  of  many 
additional  update  messages  the  aggregate  of  whi-h  is 
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potentially  larger  than  the  total  number  of  update  messages 
per  cycle  generated  by  the  Djikstra  algorithm.  Despite  the 
lesser  channel  capacity  required  to  implement  the  Djikstra 
algorithm  it  must  be  remembered  that  the  algorithm  can  only 
be  implemented  synchronously  which  may  preclude  its 
consideration  in  some  applications  Also  for  large  enough 
networks,  the  Djikstra  algorithm  will  require  more  channel 
utilization  than  would  the  Heritsch  algorithm  for  a  network 
which  is  partitioned  into  an  appropriate  heirarchy  of  groups 
and  families. 

3.  Synchronous  Versus  Asynchronous  ^dating  Performance 
When  the  utilization  versus  network  loading  curves 
for  the  asynchronous  implementation  of  the  Heritsch 
algorithm  are  compared  with  tie  curves  obtained  for  the 
synchronous  implementation  of  the  algorithm,  it  is  found 
that  there  is  very  little  difference  in  the  shape  and 

corresponding  numerical  values  of  the  respective  10/20  and 
15/30  curves.  While  only  the  results  for  these  two  networks 
are  ores art ed  here,  they  are  typical  of  results  obtained 
when  a  variety  of  different  network  topologies  were  tested 
under  different  network  Loadings  using  the  two 

implementations  of  the  Heritsch  algorithm.  The  conclusion 
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drawn 


om  these  results  is  that  for  a  given  network  and 


-e. 

Xm, 

specified  updating  cycls  time  there  is  no  significant 
advantage  in  implementing  the  Heritsch  algorithm 
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Protocol.  Since  the  simulation  programs  are  constructs i  to 
operate  on  a  predetermined  packet  length,  the  length  of  a 
user  message  is  related  to  the  number  of  packets  which  make 
up  the  message.  In  the  simulations,  the  number  cf  packets 
in  each  message  is  based  upon  a  uniformly  distributed  random 
variable  with  the  maximum  and  minimum  values  cf  the  variable 
specified  at  the  beginning  of  the  simulation.  The  mean 
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value  of  the  resulting  distribution  is  used  to  control  the 
interval  between  the  generation  of  user  messages.  In  this 
way  the  average  number  of  packets  per  second  entering  the 
network  is  maintained  as  a  constant  for  each  run  of  the 
simulation,  and  the  mean  number  of  packets  that  are 
contained  in  each  message  can  be  increased  arbitrarily. 

The  results  of  this  investigation  are  plotted  on 
each  of  the  graphs  presented  in  Appendix  F.  The  graphs 
contain  the  results  found  when  the  mean  number  of  packets  in 
a  message  was  5.5  and  10.5,  corresponding  to  maximum  message 
lengths  of  10  and  20  packet,  respectively.  No  significant 
difference  in  the  performance  of  either  the  Djikstra  or  the 
Heriisch  protocols  was  found  as  a  result  of  increasing  the 
length  of  the  user  massages.  !iean  packet  values  of  1,  3.5 

and  7.5  were  also  investigated  but  are  not  presented  here 
since  the  results  obtained  do  lot  differ  substantially  from 
these  mentioned  above. 

B.  SYNOPSIS  OF  RESULTS 

It  is  not  possible  to  conclude  that  a  particular 
Distributed  Routing  Protocol  (Djikstra  or  Seritsch)  exhibits 
bet- sr  overall  perfnrmar.cs  c.na:  acteristics  than  the  other. 
Each  algorithm  has  advantages  and  disadvantages  which  must 
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be  considered  on  the  basis  of 


the  network  in  which  the 


protocol  is  to  be  implemented.  Certainly,  if  optimal 
routing  is  a  priority  of  the  network,  than  the  Djikstra 
algorithm  is  superior.  However,  if  non-optima!  routing  is 
acceptable  and  complexity  of  terminal  eguipment  is  a 
consideration  then  the  Her it  5  oh  algorithm  has  distinct 
advantages  if  implemented  asynchronously. 

The  final  conclusion  of  this  study  is  that  the  length  of 
user  messages  does  not  degrade  the  performance  of  either 
protocol  much  when  the  average  number  of  packets  entering 

w 

the  network  per  unit  of  time  is  relatively  constant.  Thus 
the • interspersion  of  long  and  short  user  messages  is  not  a 
factor  in  the  design  of  a  packet  switching  network. 

Lastly,  it  appears  in  the  context  of  the  NTDS 
communications  network  that  the  Djikstra  algorithm  is  the 
protocol  of  choice  saould  the  NTDS  be  converted  to  a  packet 
switching  network.  While  the  asynchronous  advantages  of  the 
Heritscn  algorithm  appear  desirable  for  this  application, 
the  increasing  amount  of  information  the  NTDS  is  being 
required  to  throughput,  points  to  the  adoption  of  a  protocol 
which  requires  a  minimum  of  network  capacity  to  operate. 
Additionally,  since  units  of  tie  fleet  ace  not  constrained 
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by  the  size  and  complexity  of  the  terminal  equipment  which 
is  required  to  maintain  a  synchronized  network  (as  compared 
to  a  man-pack  version  of  a  packet  switching  network)  the 
choice  of  the  Djikstra  algorithm  for  STDS  applications  is 


reasonable , 
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APPENDIX  A 

AVERAGE  DELAY  PER  PACKET 

The  unit  of  measure  used  in  this  study  to  compare  the 
relative  performance  of  routing  protocols  in  a  given  network 
is  the  average  delay  per  packet  (Tp  ).  The  derivation  of 
the  relation  of  this  measure  to  the  link  utilization  factors 
of  the  network  is  provided  hare  and  is  based  upon  material 
presented  in  Gross  and  Harris  "Ref.  5].  and 

Kleinrock  [Ref.  6]. 

One  of  the  basic  parameters  in  queuing  theory  is  the 
utilization  factor  (?)  which  is  defined  as  the  average 
arrival  rate  of  customer  (eg.  packets  and  updates)  at  a 
service  canter  (eg.  link)  multiplied  by  the  average  time 
required  to  service  (eg.  transmit)  the  customer.  In  general 
this  is  expressed  as 

P  =  lX  (A-1) 

where 

I  =  the  average  arrival  rate  of  the  customers 

x  =  the  average  time  required  to  service  a 
a  customer 

For  this  derivation  the  suoscripts  ?  and  u  are  used  to 
indicate  that  a  particular  variable  is  referred  to  packets 
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or  updates  respectively.  Thus  the  utilization  factor  for 
packets  over  the  i-th  link  is  expressed  as 


P  .  =  1  .  x  .  (i-2) 

pi  pi  pr 


where 


1  =  the  average  number  of  oackets  per  second 

pi  arriving  for  transmission  over  a  link. 

For  an  M/M/1  queue,  the  term  Xpi  can  be  replaced  by  the 
term  1  /  uC^ ,  where  u  represents  the  percentage  of  a  packet 
which  is  represented  by  1  bit  (ie.  1  /  u  represents  the 
length  of  a  packet  in  bins)  and  C i  is  the  number  of  bits 
per  second  which  can  be  serviced  by  the  i-th  link.  Equation 
(A- 2)  can  then  be  rewritten  as 

1 

31 

9  .  *  ------  (  A- 3) 

pi  UC. 


Moreover,  for  il/M/1  systems  (ie.  a  system  with  customers 
arriving  a:  an  exponentially  distributed  rate  and  the 
service  time  per  customer  is  exponentially  distributed)  the 
expected  time  a  packet  spends  in  the  i-th  link's  queue 
before  servicing  begins  can  be  expressed  as 


/  uE. 


W  =  — - - -  (A-4) 

q  pi  UC  -  1 

i  pi 


and  the  expected  delay  far  the  delivery  of  a  packet  over  a 
link  is 


w  =  W  V  -  (A -5) 

pi  qpi  aC. 


which  is  to  say  that  the  expected  delivery  delay  for  a. 
packet  is  the  sum  of  the  expected  time  the  packet  spent  in 
the  service  queue  plus  the  time  required  to  service  the 
packet . 

The  assumption  is  made  for  the  remainder  of  the 
derivation  that  Equation  (A-4)  will  provide  a  fair 
representation  of  the  expected  delay  tine  for  a  packet  when 
the  service  time  per  packet  is  fixed  instead  of 
probabilistic  in  its  nature.  However,  since  two  types  of 
messages  (updates  and  packets!  with  different  fixed  service 
times  are  allowed  to  enter  a  link,  the  time  available  for 
the  link  to  service  packets  is  reduced  by  the  amount  of  time 
the  link  is  busy  servicing  updates.  Thus  Equation  (A-4) 
must  still  be  modified  to  reflect  the  system  perturbation 
due  to  the  loss  of  available  packe*  service  time. 
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Consider  the  case  where  xut‘  is  the  time  required  to 
service  an  update  message  and  is  the  interval  between 
the  arrival  of  update  messages  at  the  i-th  link.  The 
arrival  rate  of  updates  at  the  link  (lu.i)  is  equal  to 
(1  /  iu.i.  )  •  tJsing  Equation  (A-2)  ,  modified  to  reflect  its 
application  to  update  message,  the  utilization  factor  for 
updates  becomes 


(A-6) 


The  fundamental  interpretation  of  the  term  uC  i  in 
Equation  (A-4)  is  the  maximum  average  number  of  packets 
which  can  be  transmitted  per  second  over  the  i-th  link. 
Only  a  fraction  (  (t^  -  )/  t^-  )  of  the  time  is 

available  for  packets,  however,  when  updates  must  also  be 
transmitted.  Accordingly,  we  mast  reduce  a Z •  by  the  factor 


ui 

1  -  - 


1-0 


(  A-7) 


which  is  equivalent  to  reducing  u  to  u',  where 


J  (  1  -  D  .  ( 

Ul 


(A-9) 


Replacing  u  with  a*  in  Equation  (A-4) , 


a  new  expression 


for  Wpi.  (Equation  (A-5))  is  obtained 


l  .  /<u:.  (i  -  P  .)) 

pi  1  U1 

1 

us.  (  1  -  P  .  1  -  1 

1  ui  pi 

UC  . 

From  Kleinrock,  ‘Ref.  6].  the  average  packet  delay 
(Tp  )  for  a  network  of  service  centers  is  expressed  as 


T 

P 


(A  -10) 


where 


g  =  average  total  number  <?f  packets 
per  second  entering  the 
network 

k  =  number  of  links  in  the  network 


Substituting  Equation  ( A- 5 »  into  equation  (A- 10)  the 
expression  for  average  delay  time  for  a  packet  in  the 
network  becomes 


*n 


D 


i  :  .1  .  /<uc.  (i  -  o  .)>  i  , 

_  -  ,J-  ?- 

uC  (  1  -  0  )  -  1  uC 

L  1  'ui  p- 


(A  - 11) 


Af*er  some  simplification  this  becomes 
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1 

k 

P2.  /(I  - 

pi 

P  .) 

Ul 

(A-12) 

p  g 

2i- 

i  =  1 

1  *  P  . 

Ul 

-  P  . 

Pi 

P  . 
Pi 

Equatio  n 

(A-12) 

represents 

a  method 

of  relating  the 

network  capacity  whicl 

i  is  utilized  by  a  rout 

ing  p 

irctocol  and 

the  traffic 

loading 

level  of 

the  network 

no  the  average 

packet  delay.  For  the  simulaiion  work  presented  in  this 
study  the  utilization  factors  (p^  and  ppfc  )  were  measured 
directly  and  the  network  loading  (g)  was  an  input  parameter 
to  the  simulation. 

The  reader  should  ricte  that  Equation  (A-12)  is  valid 
only  for  comparing  the  performance  of  protocols  and  not  for 
calculation  of  the  actual  performance  of  a  protocol. 
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APPENDIX  B 


NETWORK  CONFIGURATIONS 


[.  B.l.  The  5/10  Network 


3.2.  The  13/20  Network 


.  Ths  15/30  Network 


The  20/40  Network 


APPENDIX  C 

HERITSCH  ALGORITHM  (SYNCHRONOUS):  PROGRAM  LISTING 
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SEND  CUT  UPDATE;  OThERWISE,  PLACE  UPDATE  IN  QUEUE 
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OUTGOING  UPCATE  QUEUE  AT  ****.♦*♦♦**  SEC 
OUTGOING  UPCATE  QUEUE  FROM  NODE  ***  IS  ******** 
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APPENDIX  D 

LISTING  OF  ARRASTS  USED  IN  THE  SIMULATION  PROGRAMS 


Arrays  com  men  to  all  programs: 


1  -  dimensional  arrays 


F A  M. OF. GRP  (no. of  codas  ♦  groups  ♦  25) 
1st  --  program  ID  of  the  i-ta  gro 


group 


HISTOGRAM  (ID) 

1st  --  no.  of  links  with  utilization 
factor  =  i/10 


PKT.QU.DISTR  (1030) 

1st  --  number  of  times  packet  queue  siz£ 


UP.QU.DISTR  (  1000) 

1st  --  number  of  times  update  queue  size 


-  dimensional  arrays 


CLOCK. DATA  (10  *  no. of  nodes,  2) 

1st  --  number  of  iods  =  N 

2nd  --  1  =  net  time  for  all  packets  hooDino 

»  nodes 

2  =  highest  individual  trio  time  for 
a  M  hop  packet 


t 


HOP. COUNT  (13  *  no.  of  lodes,  2) 

1st  --  number  of  aops  =  N 
2nd  —  1  »  lot  used 

2  =  no. of  packets  hopping  3  nodes 


LINK.  ABLE  (no  ,of  links,  2) 

1st  --  Link  number 
2nd  --  1  =  first  end  node 
2  =  second  end  node 


PKT. SMP.SET  ( selectedliaks  to  be  sampled,  2) 
1st  --  sample  link  ID  number 
2nd  --  1  =  'from'  node  ID 
2  =  *  to*  node  ID 


TRACER  (estimate  of  the  maximum  number  of 
messages,  2) 

1st  --  message  number 

2nd  --  1  *  number  of  packets  in  the  message 
2  =  number  of  packets  of  the  message 
Khich  reach  their  destination 


UP. SMP.SET  (selected  links  to  be  sampled,  2) 
1st  --  sample  link  ID  number 
2nd  --  1  =  ’from’  .node  ID 
2  =  • to'  node  ID 


dimensional  arrays 


BEST.  PATH  (no. of  nodas  ♦  groups,  no.  of  nodes 
♦  groups,  4) 

1st  --  'from'  node,  group  or  family  ID 
2nd  --  'to'  noda,  group  or  family  ID 
3rd  --  1  =  current  best  path  neighbor 

2  =  channel  value  through  the  current 

bast  path  neighbor 

3  *  best  oath  neighbor  to  be  adopted 

during  next  update  cycle 

4  =  channel  value  to  best  path 

neighbor  which  will  be  adopted 
during  next  update  cycle 


LI  NK.  MONITOR 
1  st 

2nd  -- 
3rd  -- 


(2  *  no. of  links,  2  *  no. of  links, 
' from  *  node  ID 
1  to*  node  I D 

1  =  Link  status  (idle/busy) 

2  =  current  packet  queue  of  link 

3  =  max  oacket  queue  thus  far 

i  -  current  update  queue,  of  link 
5  =  max  update  queue  thus  far 
3  =  no.  of  packets  in  queue  at  the 
simulation  half 


6) 


NEIGHBOR.  LI3T  (no.  of  nodes,  max  links  per  node,  3) 
1st  —  i-th  node  ID 
2nd  --ID  number  of  link 
3rd  --  1  =  neighbor  node  ID 

2  =  link  status  (idle/busy) 

3  =  channel  value  from  none  to  neighbor 


4  -  dimensional  array 


LI NK. TIMER  (2,2*  no.  of  links,  2  *  no.  of  links 

1st  —  1  =  packet 
2  =  update 

2nd  —  sending  node  ID 

3rd  --  receiving  node  ID 

4th  —  1  =  start  time  for  busy  link 

2  =  stop  time  for  busy  link 

3  =  rummulaf i ve  time  link  is  busy 

4  =  oummulitive  time  link  busy  up  to 

simulation  half 


additional  arrays  for  Djiksta  algorithm: 


2  -  dimensional  arrays 


ADDRESS. LIST  (no.  of  nodes,  i 
1st  --  sending  node  ID 
2nd  —  destination  node 


nodes) 


ADD.  HESS. LIST  (np.  of  nodes,  no.  of  nodes) 
1st  --  sending  node  ID 
2nd  --  destination  node  ID 


DJIKSTRA.SAIK  IX  (no. of  nodes,  no.  of  nodes) 
1st  --  sending  node  ID 
2nd  --  destination  node  ID 


PATH.  AVAIL  (no.  of  nodes,  no.cf  nodes) 
1st  --  sending  node  ID 
2nd  --  destination  node  ID 


4 


P 


AP£ENDr J  E 

SAMPLE  INPUT  AND  OUTPUT  DATA 


f: 


r i 


t 


* 


Input  data  set: 


1. 

1. 

1. 

1. 

1. 


5 

1. 

1. 

1. 

1. 

1 . 

0.  1 
0.0001 
0.05 
30. 

0.5 

00.  0  0. 

0 

5  500 

0 
4 
1 
1 
1 
1 
2 
2 
2 
3 

3 

4 


2 

3 

4 

5 

3 

4 

5 

4 

5 
5 


1 

1 

1 

1 

1 


a  ode.  factor 
a .node 

t  ransmit.  percent  (  ) 


ip. date. period 
p  recessing, time 
pkt.xmn. time 
t ime. limit 

window  (  for  channel  value  ) 
in. group  -  in. family 

P  cnx 

smp. Links  -  no. of . samples 
1  inks 

max. links. per . node 

node  no.  -  node  no.  (defines  link  ends) 


(S 


I 
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Output  data  set: 


*#*«««¥*#*«*****«#«* 


NEW  SIMULATION 

MAX.FKTS.PER.MSG  *  10. CO 
PKTS.FER  .S6C.AVE  *  15C.00 


*«»»»**»*« 


—  UTILIZATION  FACTOR  ~ 


1/  2 
2/  1 


1/  4 
4/  1 
1/  5 
5/  1 
2/  3 
2/  2 
2/  4 
4/  2 
2/  5 
5/  2 


5/  4 


PACKET 

.616656 
.566655 
•6C6655 
.542231 
.605995 
.565594 
.545587 
.645581 
.6C6654 
.622234 
.656654 
.57959  C 
.542325 
.593228 
.575595 
.635987 
•  546652 
.666646 
.575586 
.625584 


UPDATE 


TOTAL 


AVE.P.FLGW  * 
AVE.U.FLCW  = 


. 55845C 
• C46512 


AV6  .NETWORK  .FLOW  * 
GEN. COUNT  =  4 

OEST.CCUNT  = 
TRANSIT. TIVS  = 
STRANCEO . W A  IT  = 

T. IN. LINK  = 

0. IN. LINK  =  K. 

CHECK. DELAY  a 
AVE. DELAY. PER. PK7  = 
RATIO. STRANCEC  = 


=  .645403 

4421 
4314 

3051.942139 
49.1CC677 
. 4C 1688 
1C. 716658 
,  .7C295C 

T  =  .225555 

.0248C3 


PKTf  IN  CUELE  AT  HALF* 

PKTS  IN  CUSUE  AT  ENC  = 

INTERVAL  NUMEER  CF  LINKS 

0.  -  .10  0 

.1C  -  . 2C  0 

.20  -  .3 C  0 

• 2C  -  .4C  0 

«4C  -  .5C  0 

.50  -  .6 C  4 

.  6C  -  . 7 C  14 

.70  -  . 8C  2 

.8C  -  .9C  0 

,9C  -  l.CC  0 

S I KUL ATI CN  STCPS 


PKTS  IN 
QUEUE  AT 
HALF 


PKTS  IN 
QUEUE  AT 
ENO 


• C445 1 5 

.661177 

c 

2 

.046663 

.613318 

10 

o 

.C476C1 

.654255 

6 

13 

.  C4  5552 

.588924 

1 

14 

.045454 

.655453 

4 

o 

.C45723 

.615717 

0 

o 

•C45556 

.595563 

0 

o 

•C46126 

.696107 

c 

o 

.045322 

.651966 

11 

o 

.047988 

.671322 

G 

3 

.045325 

. 701963 

4 

14 

.C47152 

.627162 

3 

10 

.046662 

.589967 

12 

0 

.047728 

.641056 

0 

o 

.047566 

.627565 

0 

16 

.049457 

.689444 

0 

7 

.C47190 

.593842 

14 

5 

. C5C8C6 

.717454 

6 

o 

.C47987 

.627975 

15 

5 

.C47727 

.687710 

12 

4 

WAIT  TIME 
FOR  PKTS 


1.751269 
1 . 43 7c 9 3 
1.724311 
1.295773 
1.741385 
1 .455554 
1 .333o 76 
2.1Q74lc 
1.7i42o 2 
1.865066 
2.172235 
1  •  5264c5 
1.29a54o 
1 .623242 
1.523421 
2.027401 
1.316626 
2.323752 
1.525767 
2.017254 


< 


APPENDIX  P 
GRAPHICAL  RESULTS 


DELAY  :  HERITSCH  ALGORITHM  ;  SYNCHRONOUS 
NODES  -  S,  LINKS  -  10 


Fig.  F.  1 .  Delay:  Heritsch  (synch).  Network  5/13 
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flVERHGE  DEI. nr  PLK  PACKET  mSECCNDS 


OELflY  :  HER ITSCH  ALGORITHM  ;  SYNCHRONOUS 
NODES  -  15,  LINKS  -  30 


COO  £50  300  350 

fiVE  NUM5ER  CP  PACKETS  PER  5ECCN0 


Fiq.  F.3.  Delay:  Hecitsch  (synch),  Natwork.  15/30 


J 


AVERAGE  DELAY  PER  PACKET  xSECONOS* 


n 


DELAY  :  HERITSCH  ALGORITHM  ;  SYNCHRONOUS 
NODES  -  20,  LINKS  -  40 


< 


Fig.  F.4. 


Delay:  Hecitsoh  (synch) , 


Network  20/40 
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so 


iso  coo  050  ::o 

RVE  NUMBER  OF  PHCKETS  PER  5ECOKD 


? — 
350 


,g.  P.5.  Delay:  aecitsca  (synrti)  ,  Network  10/20  (2 


<oo 


gro  ups) 
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GROUP 


RVfc.RriiJf'  Df'l.ni  Pf.K  PHi'KLT  x^FCONDS* 


,  - i - ; - 1 - [ - 1 1 - ! 

0  50  500  150  200  250  300  3S0 

five:  number  or  packets  per  second 

» 

v 


I 


I 


l 

r 


Pig.  F.9.  Delay:  Djikstra,  Network  5/10 
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fWEKRGE  DELRY  rER  PHCKET  *iECONDS 


NETWORK  UTILIZATION  FACTOR 


h 


C 


8 

If 


f 


UTILIZATION  FACTOR  :  HERITSCH  ALGORITHM  ;  SYNCHRONOUS 
NODES  -  5,  LINKS  -  10 


O 


4 

/ 


Figure 


4 


F.13. 


Utilization  Factor:  Heritscfa  (synch) ,  Network 
5/10 


4 
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NETWORK  UTILIZATION  FACTOR 


i 


Figure  F.14.  Utilization  Factor:  Heritsch  (synch).  Network 
1  0/20 
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NETWORK  UTILIZATION  EflCTOR 

0.2  0.3  0.4  O.S  O.o  0.7  0.8 


UTILIZATION  FACTOR  :  HERITSCH  ALGORITHM  ;  SYNCHRONOUS 
NODES  -  15,  LINKS  -  30 


Q 


Figure  F.T5.  Utilization  Factor:  Heritsch  (synch).  Met 


NETWORK  UTILIZATION  EACTOR 


UTILIZATION  FACTOR  :  HERITSCH  ALGORITHM  ;  SYNCHRONOUS 
NOOES  -  20,  LINKS  -  40 


o 


ISO  200  250  300  350  >100  450  500 

AVE  NUMBER  OF  PACKETS  PER  SECOND 


Figure  F.16.  Utilization  Factnr:  Heritsch  (synch).  Network 


O 


jc 

i 


« 

. 

. 

. 


B 
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UTILIZRTION  FACTOR  :  HERITSCH  ALGORITHM  ;  STNCH  :  GROUPS 
NOOES  -  10,  LINKS  -  20 


r  4 


Figure  F.17.  Utilization  Factor:  Heritsch  (synch).  Network 
10/20  (2  groups) 


147 
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NETWORK  UTIL12BT10N  FRCTOR 


X 

i 

« 

UTILIZATION  FACTOR  :  HER  I TSCH  ALGORITHM  ;  SYNCH  :  GROUPS 
NODES  -  15,  LINKS  -  30 


AVE  NUMBER  OF  PACKETS  °ER  SECOND 


Fiqure  F.T8.  Utilization  Factor:  Heritsch  (synch),  Network 
15/30  (3  groups) 
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NETWORK  UT1L1ZRTION  FACTOR 


UTILIZATION  FACTOR  :  HERITSCH  ALSORITHM  ;  ASYNCHRONOUS 
NODES  -  15,  LINKS  -  30 

O 


.  Utilization  Factor:  Heritsch  (asynch) ,  Network 
10/20 

14? 


Figure  F.19 


100  150  200  250 

FIVE  NUMBER  OF  PACKETS  PER  SECOND 


Fig.  F. 2 1.  Utilization  Factor:  Djikstra,  Network  5/10 


NETWORK  UliLIZRT ION  EOCTOR 


UTILIZATION  FACTOR  :  OJIKSTRA  ALGORITHM  ;  SYNCHRONOUS 
•NODES  -  10,  LINKS  -  20 


O 


?ig.  F.22.  Utilization  Factor:  Djikstra,  Network  10/20 
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NETWORK  UTILIZATION  FACTOR 


UTILIZATION  FACTOR  :  DJIKSTRA  ALGORITHM  ;  SYNCHRONOUS 
NOOES  -  IS,  LINKS  -  30 


SI  AVERAGE  UPDATE! 

|  UTILIZATION  FACTOR 

I  _  n  n-r*  : 


AVE  NUMBER  OF  PACKETS  PER  SECOND 


Pig.  F.23.  Utilization  Factor:  Djikstra,  Network  15/30 
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UTILIZATION  FACTOR  :  DJIKSTRA  ALGORITHM  ;  SYNCHRONOUS 
NODES  -  20,  LINKS  -  40 


P.24.  Utilization  Factor:  Djikstra,  Network  20/40 
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